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The primary purpose of the present study was to replicate an 
exp e r irncn t previously c on. due ted by B a. Id w in and Bailey (1971) in order 
to establish the reproducibility of their results in a different user 
environment. Twelve psychometric instruments employing technical 
training materials which required various types of visual skills were 
used in the testing. Three forms of each test exercise were 
reproduced: hardcopy, positive- image microfiche, and negative- 

image microfiche. Ninety subjects were randomly assigned to one of 
three experimental groups (hardcopy, pos itive- image, and negative- 
image). A.n analysis of variance (Winer, 1962; Myers, 1966) revealed 
F values to be significant beyond the . 01 level for Test 4, Figure 
Identification; Test 6, Symbol Translation; Test 7, Graphs; Test 8, 
Tables; and Test 12, Number Verification; and beyond the . 05 level for 
Test 5. Length Estimation. No significant differences in performance 
were found between positive and negative- image microfiche presenta- 
tions. These results generally substantiate those reported by Baldwin 
and Bailey. Further analyses demonstrated that the reader presenta- 
tion primarily affected the speed at which the subjects worked while 
accuracy was not differentially affected by the presentation mode. An 
analysis of the performance of subjects grouped according to Armed 
Forces Qualification Test (AFQT) scores indicated that various intel- 
ligence groups were differentially affected by the mode of presentation. 
While statistical differences were found in a number of test exercises, 
no fundamental difficulties were encountered which would bar future 
utilization of microform material^ in technical training programs. 
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SUM MAR Y 



Denver Research Institute, University of Denver. A Performance 

Evaluation: Microfiche versus Har dcopy . AFHRL-TR-7 1-42, 

Lowry AFB, Colo. : Technical Training Division, Air Force 

Human Resources Laboratory, May 19 M. 

Qbj e c 1 1 v e s 

The primary objectives of this study were (a) to replicate an 
experiment conducted by Baldwin and B>ailey in 1971 to establish the 
reproducibility of their results in a different user environment, and 
(b) to establish the reliability of instruments which they developed 
as tools for use in future Air Force microfiche evaluations. 

Approach 

Three forms (hardcopy, pos itive- image microfiche, and 
negative- image microfiche) of twelve psychometric instruments 
employing technical training materials were developed for this study. 
Ninety Air Force trainees were randomly assigned to one of three 
experimental groups (hardcopy, pos itive- image and negative- image) and 
performance comparisons were evaluated in terms of the study 
objectives . 

F hidings 

The major findings in terms of the replicative aspects of the 
study were: 

1, Baldwin and Bailey^s finding of no significant difference in 
performance, using narrative-type materials, among any of the p re- 
sent at ion modes was confirmed in terms of the overall experimental 
results . 



2, The original finding of no significant difference in perfor- 
mance across all instruments for the positive versus the negative 
microfiche presentations was also confirmed. 

3. Significant differences between fiche and hardcopy perfor- 
mance for three of the nine non-narrative, visual discrimination instru- 
ments were encountered in both studies, but three additional instruments 
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also showed significant performance differences between hardcopy and 
one or both of the fiche presentations in the present study 0 

In general, then, the Baldwin and Bailey results were replicated; 
their main results could be extended to a different environment, a 
different time, and to different equipment. Further analyses resulted 
in two additional findings; 

1, The microform presentation primarily affected the speed at 
which the subjects worked while accuracy was not differentially affected 
by the presentation, 

2. An analysis of the performance of subjects grouped accord- 
ing to AFQT scores indicated that various intelligence troups were 
differentially affected by the mode of presentation. 

This summary was prepared by Dr, Edgar A, Smith, Technical 
Training Division, Air Force Human Resources Laboratory , 
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A PERFORMANCE EVALUATION: MICROFICHE 

VERSUS HARDCOPY 



I, INTRODUCTION 

Microforms have long been used in industry and government as 
a storage and retrieval tool having enormous administrative value and 
varying user value, * In educational environments, however, micro- 
forms (although now widcdv distributed) reflect primarily an adminis- 
trative solution to the problems of acquiring and storing specialised 
materials. This results in a limited number of applications and, 
therefore, a limited user group. The ability of individuals to effec- 
tively use microform training materials must be examined before 
educational applications can be expanded from their substitution for 
hardcopy to their routine utilization as a new communication medium. 

Experimental studies are needed which consider the question, 
"To what extent are the cognitive skill levels of students preserved 
when using a microform presentation?" In one such study, 

Kottenstette (1969) determined in a reading experiment that there are 
no fundamental physical or psychological barriers to the utiliza.tion of 
microforms in the communication of narrative information that the 
student customarily encounters in hardcopy. Students are able to 
preserve skill levels (reading rate and comprehension) when utilizing 
reaoer presentations of both descriptive and abstract narrative mate- 
rials which reflect various levels of difficulty. 



# The term microform, as employed in this report, is intended to 
include microfiche, ultrafiche, ultra-reduced microcopy and photo- 
chromatic images. The COSATI standard microfiche form was used 
in this study. 



Baldwin and Bailey (1971) also found that, for narrative 
reading at least, students could perform adequately using microfilmed 
materials. These investigators conducted an extensive and thorough 
re' iew of the technical training materials used at the Chanute Technical 
Training Center, Chanute Air Force Base, Illinois. After consulting 
with a number of experienced training specialists, they dove 1 oped 
twelve tests which represent the various visual skills involved in the 
utilization of these materials.* Three forms of each test master were 
reproduced (hardcopy, positive - image microfiche, and negative- 
image microfiche) and presented to three separate trainee groups. 

The experimental results indicated statistically significant differences 
favoring the hardcopy presentation for three of the twelve tests. All of 
the significant differences were encountered in tests which involved 
character recognition and symbol interpretation as opposed to reading 
continuous prose. The authors concluded that, in terms of 
"readability, " materials presented via microfiche are feasible for 
future technical training purposes. 

"Readability, " e\ s conventionally used in relation to hardcopy, 
has been defined in terms of the difficulty or complexity of the content 
of the material. Applying this definition, more readable (easier, less 
complex) material is likely to result in greater understanding, learn- 
ing, and retention than less readable (more difficult, more complex) 
material (Kiare, 1963). When hardcopy materials are transferred to 
microfiche, a somewhat different definition is employed which can 
best be understood in terms of the distinction made by Kottenstette (1969) 
between readability and visibility. 

* It should be emphasized that the tests developed were not designed 
to represent technical training .content areas but rather visual skills . 



Some of the image quality of the hardcopy is lost in the transfer 
to microfiche, both in the photographic reduction process and in the 
reader magnification process. A substantial loss of image quality can 
be tolerated with little effect on the user's reading skills when 
readability depends on the recognition of complete words or groups of 
words in context, as in narrative materials. However, with materials 
which, by their natu. content, or purpose are dependent upon individ- 
ual character recognition, o. visibility , the reduced image quality may 
affect cognitive skill levels. 

The distinction made here between readability and vis ibility is 
important becau’se the tests developed by Baldwin and Bailey focused 
on the visual skills utilized in training, not on the content of the mate- 
rials encountered. This suggests that the successful completion of 
many of the test exercises was more dependent upon visibility than 
upon readability, as these terms are last defined above. However, in 
some cases, the exercises involved more than a simple visual dis- 
crimination task; in order to complete the exercise, the subjects were 
required to assimilate, process, and use that which was discriminated. 
In this way, the term "readability" was expanded in the Baldwin 
and Bailey study to include the interpretation and coding skills as well 
as the visual discrimination skills involved in dealing with schematics, 
wiring diagrams, flow charts, tables, graphs, and three-dimensional 
drawings . 

Purpose of Study 

The present study is part of a larger research effort designed 
to develop and evaluate microforms for use as primary source mate- 
rials in Air Force technical training programs. Data from three 
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investigations will be analyzed and reported separately in response 

¥ 

to the following questions: 

(1) Can Air Force trainees use microform presentations of 
educational and training materials to an extent consistent with their 
use of hardcopy materials? 

(2) What are the optimal microform formats to be used in 
presenting technical training materials? 

(3) What ar e the costs, advantages, and disadvantages of 
microform presentations in actual classroom use? 

T* addition, a user-oriented guide to the utilization of micro- 
form technology in technical training will be prepared, based on a 
review of the literature and the insights which result from the 
research effort. 



The research reported here addresses the first of the questions 



enumerated above. It was designed primarily to replicate the experi- 
ment conducted by Baldwin and Bailey in order to establish the 
reproducibility of their results in a different user environment, and to 
establish the reliability of instruments which they developed as tools 
for use in future Air Force microfiche evaluations. This study had the 
secondary purposes of providing insights into the strengths and weak- 
nesses of microform presentations in an operational sense, as well as 
generating criteria for evaluating the psychological or training implica- 
tions of using microforms as primary source materials in technical 
training. 

Hypotheses 



research objective. The first stated that (1) students using the hard- 
copy presentation would perform significantly better than students using 



Two hypotheses were develop ed-'to help meet the primary 
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either the positive- image or the negative- image microfiche presenta- 
tions, This hypothesis was based on Baldwin and Bailey's finding that 
when the method of presentation affects the "readability" of material, 
the advantage favors the hardcopy presentation. The second hypothesis 
stated that (2) there would be no significant performance difference 
between subjects using pos itive- image microfiche and subjects using 
negative- image microfiche. The second hypothesis was stated in a 
ncn-directional form because the question of film polarity had not been 
adequately resolved before the present study was conducted. 

Baldwin and Bailey encountered enormous variance in their 
data suggesting that a stratification of the subjects based on an intel- 
ligence index might prove valuable. It appeared possible that highly 
intelligent subjects would respond to the machine presentation with 
increased or decreased sensitivity as compared with less intelligent 
subjects. An additional hypothesis, therefore, stated that (3) subjects 
divided into high, medium, and low intellectual groups ,v u ’Id be dif- 
ferentially affected by the presentation mode. 




* 
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II. METHOD 



P s ychomet rie Instruments 

The tesc exercises used in this study were developed by Baldwin 
and Bailey and required many of the types of visual skills used in Air 
Force technical training programs. Performance requirements 
included: the reading of continuous prose and shortparagraphs ; reading 

schematics, wiring diagrams, and flow charts; identifying and dis- 
criminating precise figures and symbols; and reading charts, tables, 
graphs, and three-dimensional drawings. 

Several of these test instruments were reproduced or adapted 
from the Kit of Reference Tests for Cognitive Factors , copyrighted by 
the Educational Testing Service, Princeton, New Jersey, and developed 
under Office of Naval Research Contract Nonr-221 4(00), Project 
Do:: i gnat ion NR- 151- 174 (1963). Reproduction of these test instruments 
is permitted by and for United States Government use. 

The following paragraphs contain a short description of each 
test exercise. The time limits presented were taken from Baldwin and 
Bailey who established them at two standard deviations above the mean 
time for completion of one-half of the test (based on pretest data; 

N = 42). All tests were scored by counting the number of correct 
responses for each test exercise. The test instructions and sample 
items of each test are included as Appendix A. 

Tests 1 and 2, Narrative-Continuous Prose. Material for this 
section was selected from the survival training text of the ATC Student 
Study Guide OZR 1515A, The content was rewritten as continuous, 
uninterrupted prose and modified by deleting three key words on each 
page and replacing them with blanks'. The task was to read the 
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material and supply the missing words (Part I 50 minutes; Part II 
25 m inutes) . 

Test 3, Narrative-Short Paragraph . The same type of mate- 
rial as used in the continuous prose exercises was used in this test; 
one-hundred paragraphs, two or three sentences in length, were 
isolated from the text and modified by changing one word in each para- 
graph to be inconsistent with the meaning of that paragraph. The 
subjects were repaired to read the paragraph and identify the incon- 
sistent word (25 minutes). 

Test 4, Figure Id entification. For each item, the subjects 
indicated which of five geometrical figures or pictures in a row was 
identical to a figure presented at the left of the row (5 minutes). 

Teat 5, Length Estimation . Each item consisted of two points 
connected by three curved or angular lines. The task of the subjects 
was to select the shortest of the lines (3 minutes). 

Test 6, Symbol Translation . This was a test of the subjects' 
ability to translate symbols into alphabetic characters. A legend 
presented alphabetic letters and their corresponding symbols. Each 
item consisted of a short series of symbols; the subjects were required 
to identify the alphabetic characters which corresponded to each 
symbol (10 minutes). 

Test 7, Graphs . Four curves on a graph plotted the relation- 
ship of temperature to time (in minutes) under certain experimental 
conditions. For each test item, the minutes were given. The task was 
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to indicate the temperature which corresponded to the given number oJ 

minutes fox* each curve (7 minutes). 

Test 8, Tables . A table was presented which contained drill -bit 
sizes and their corresponding decimal equivalents. The task * vs to 
refer to the table and indicate the decimal equivalent for each of the 
given drill-bit sizes (4 minutes). 

Test 9, Mechanical Drawing . Subjects were required to locate 
lines, and surfaces on three separate views of an object (front, side, 
and top) corresponding to lines and surfaces on a three-dimensional 
view of the same object (5 minutes). 

Test 10, Schematics . An item cons.sted of a network of lines 
as in an electrical-current diagram which has many intersecting and 
intermeshing wires and five sets of terminals, each marked 5 (start) 
and F (finish). The task was to follow the lines and to determine 
through which pair of terminals there was a complete circuit from S, 
through a circle at the top of the diagram, to F (15 minutes). 

Test 11, Flow Diagrams . The subjects were presented with 
diagramatic sections representing city maps with the streets blocked 
at various points by barriers. They were required to select the 
shortest path between two points so that no roadblocks need be crossed 
( 7 minutes) . 

Test 12, Number Verification . The subjects inspected pairs' of 
multi-digit numbers and indicated whether the two sets of numbers 
differed or were identical (6 minutes). 
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Baldwin and Bailey determined the reliability of each test using 
the following procedure: One-half of each test was administered on 

successive days to a sample of 42 subjects, using only the hardcopy 
presentation. After test reliabilities were computed, the Spearman- 
Brown prophecy formula was used to estimate reliabilities for the total 
test length. Results of the analysis are presented in Table I and 
indicate that, in general, the reliabilities ire within a range acceptable 
for making comparisons among treatment groups. A possible exception 
is Test 11, Flow Diagrams, which has a reliability of . 59. It would be 
necessary to increase this exercise to 2. 78 times its present length to 
achieve a reliability of . 80. The remaining eleven tests have reliabili- 
ties ranging from .76 to .93, 



Table I. Reliability C oeffic ients 
N = 42 



Test No. 




r xx 


1 . 


Narrative (50 minutes) 


. 92 


2. 


Narrative (25 minutes) 


, 85 


3. 


Narrative - Short Paragraph 


. 79 


4. 


Figure Identification 


. 90 


5, 


Length Estimation 


. 90 


6 . 


Symbol Translation 


. 79 


7. 


Graphs 


. 93 


8. 


Tables 


. 76 


9. 


Mechanical Drawing 


. 90 


10. 


Schematics 


. 88 


11. 


Flow Diagrams % % 

hi 


. 59 


12, 


Number Verification 


. 91 
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The test masters prepared by Baldwin and Bailey were used to 
reproduce the testing instruments used in this experiment. It should be 
emphasized that the same masters were used to produce the hardcopy 
and to film the pos itive- image and negative- image microfiche forms. 
Equipment and Testing Environment 

The reader used in this study, the Eastman R ak Recordak 
Easamatic Reader, Model PFCD, is a tabletop, film reader 
designed specifically for viewing images on 4- by 6 -inch microfiche 
having DOD, NMA or COSATI formats. The readers could accom- 
modate both positive- and negative- image microfiche. 

The experiment was conducted at the Human Resources Labo- 
ratory, Lowry Air Force Base, Colorado, A large room was provided 
and equipped with six 30- by 54- inch tables. Four tables were used to 
accommodate microfiche readers and the remaining two were used for 
hardcopy work. 

The ambient illumination level normally varied from approxi- 
mately 40 foot-candela to 50 foot- candela over the duration of the daily 
experimental period. The variation, due to sun position, was well 
within the comfort range for reading offset copy. The overall environ- 
ment was typical of an office setting. 

Subjects 

Experimental subjects were obtained from Air Force technical 



training students or Personnel Awaiting Training Status (PATS) at 
Lowry Air Force Base, Colorado. All subjects were high school 
graduates; none held college degrees, although some had limited 
college experience. To test the hypothesis of no difference among 
the subject distributions in the three treatment groups used, a 
chi-square test using the Armed Forces Qualification Test (AFQT) 



scores was computed. 




F* 
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The AFQT includes vocabulary, arithmetic reasoning, and 
spatial relationship problems, the last-named involving the recognition, 
perception, manipulation, and analysis of relations in two and three 
dimensions (Uhlaner, 195Z). Items were selected on the basis of dif- 
ficulty level as well as on the basis of their correlations with subtests 
and the total test scores. 

The resultant chi square value of 9. 83 5 for 18 degrees of free- 
dom was not significant (p > . 50), and indicated that there were no 
significant differences among the three groups in terms of AFQT 
scores. 

Testing Procedures 

Ninety subjects were tested, 30 in each of the three treatment 
groups , * All subjects were airmen awaiting training at the Lowry 
Technical Training Center, Lowry Air Force Base, Colorado. The 
subjects were assigned in a quasi- random manner to testing positions 
resulting in two subjects for vuch of the three treatment groups eacli ses 
sion. All test instruments were administered by the same investigator 
using standardized test procedures and instructions. The total test 
battery required approximately four hours to complete. Forty minutes 
of this time, however, was devoted to breaks; two ten-minute breaks 
and one twenty -m inute break each day. The order of presentation was 
counterbalanced to distribute possible practice and fatigue effects 
equally over all conditions. That is, the instruments were administered 
in fifteen different sequences within each group, one for each test day. 
The orders of presentation are presented in Appendix B. 



* 94 students were actually run; four subjects were eliminated, 
because they were unable to complete, the entire test sequence. 
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III. RESULTS 



The primary purpose of this study was to replicate a previous 
experiment (Baldwin and Bailey) to determine the effect of three dif- 
ferent methods of presentation on the ability of subjects to process 
several types of information through the visual modality. As in the 
original experiment, separate analyses of variance were computed for 
each of the twelve test exercises. 

The results of the single classification analyses of variance are 

presented in Table II. F values for the test exercises were found to be 

significant beyond the .01 level for Test 4, Figure Identification; Test 6, 

Symbol Translation; Test 7, Graphs; Test 8, Tables; and Test 12, Num- 

\ 

ber Verification; and beyond the ,05 level for Test 5, Length Estimation, 
(These exercises include Tests 4, 6, and 7, Figure Identification, Symbol 
Translation and Graphs, in which significance was also found in the 
original study by Baldwin and Bailey using the same procedure.) 

Since the analyses of variance resulted in significant F values 
for Tests 4, 5, 6, 7, 8, and 12, further analyses were conducted to 
determine the significance of differences between pairs of means. The 
Scheffe method of making post-hoc comparisons (Scheffe, 1959) was 
selected for use in this study because it is applicable in situations 
where a preliminary analysis of variance has shown overall signifi- 
cance. In addition, the Scheffe test has no requirement that post-hoc 
comparisons be independent; it can be used to make any and all com- 
parisons of interest to the investigator. It was used, therefore, to 
compare all pairs of means in the analysis. The Scheffe method is 
more conservative than other multiple comparison methods with regard 
to Type-1 error, and leads to fewer significant differences. Since the 
Scheffe method is so conservative* '/this study followed the 
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Table II. Analysis o£ Variance for 12 Tests 





Source of 


Sum of 




Mean 


F 


Test 


Variation 


Squares 


df _ 


Square 


Ratio 




Between groups 


668. 42 


2 


334. 21 




Narrative (50) 


Within groups 


49407. 90 


87 


567. 91 


. 588 




Total 


50076. 32 


89 


562. 66 






Between groups 


310. 40 


2 


155. 20 




Narrative (25) 


Within groups 


16314. 50 


87 


187. 52 


, 828 




Total 


16624. 90 


89 


186, 80 




Short 


Between groups 


399, 09 


2 


199, 54 


1. 205 


Paragraph 


Within groups 


34404, 03 


87 


165, 56 




Tot h: 


14803, 12 


89 


166. 33 




Figure 


Between groups 


2895, 62 


2 


1447. 81 


14, 083*$ 


Identification 


Within groups 


8944. 33 


87 


102. 81 




Total 


11-839, 96 


89 


133, 03 




Length 


Between groups 


422,49 


2 


211. 24 


4, 452* 


FatLmation 


Within groups 


4127, 83 


87 


47. 45 




Total 


4550. 32 


89 


51. 13 




Symbol 


Between groups 


20376. 80 


2 


10188. 40 




Translation 


Within groups 


1 10856. 80 


87 


1274, 22 


7, 996** 




Total 


131233. 60 


89 


1474, 53 






Between groups 


1197.07 


2 


598. 53 




Graphs 


Within groups 


8620. 93 


87 


99. 09 


6, 040** 




Total 


9818. 00 


89 


no, si 






Between groups 


442. 96 


2 


221, 48 




Tables 


Within groups 


2818, 03 


87 


32, 39 


6. 838** 




Total 


3260. 99 


89 


36. 64 




Mechanical 


Between groups 


1059. 36 


2 


529, 68 




Drawing 


Within groups 


34957. 13 


87 


401, 81 


1,318 




Total 


36016, 49 


89 


404. 68 






Between groups 


I. 87 


2 


0, 93 




Schematic s 




3073, 73 


87 


35. 33 


0, 026 




Within groups 






Total 


3075. 60 


89 


34, 56 




F low 


Between groups 


338. 29 


2 


69. 14 




Diagrams 


Within group a 


3690. 17 


87 


42, 42 


1. 630 




Total 


3828,46 


89 


43.02 




Number 


Between groups 


524.47 


2 


262. 23 




Verification 


Within groups 


4463. 63 


87 


61,31 


5, 111** 




Total 


4988. 10 


89 


56. 05 





* Significance beyond the . 05 level 
** Significance beyond the . 01 level 
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recommendation of Ferguson (1966) that a loss rigorous level of 
significance (. 10) be used. A brief description of the computations 
involved in applying the Scheffe test are presented in Appendix C. 

The means and standard deviations for each group, on each 
test, are presented in Table III, The results of the Scheffe tests for 
significance ol differences between these means are presented in 
Table I\ , and indicate that subjects using the hardcopy presentation 
performed significantly better than subjects using either the positive- 
image o_r the negative- image microfiche presentations for Test 4, 
Figure Identification; Test 5, Length Estimation; Test 6, Symbol 
Translation; and Test 12, Number Verification, In addition, test 



means for the hardcopy group were significantly higher than test means 
for the negative- image group only on Test 7, Graphs; and Test 8, 
Tables, These differences were significant at the suggested . 10 level. 
None of the differences between means for the positive- image versus 
the negative- image microfiche groups were significant. 

In the original experiment, Baldwin and Bailey, using t-tests 
to determine significant inter-group differences, found the mean score 
for hardcopy was significantly higher than the mean score for either 
positive or negative microfiche for Figure Identification, Symbol Trans- 
lation, and Graphs. 

The methodology established for the scoring of the test 
exercises (Le,, counting the number of correct responses made during 
established time limits) did not allow the consideration of speed and 



accuracy as separate factors . A post-hoc analysis, therefore, was 
conducted to provide some insights into this question. In this analysis, 
the ratio of correct responses to attempted responses was computed 
for each treatment group, on each test, as a rough-measure of accuracy. 



14 



able III . T e s t M cans an d S t anda r d D e via t i o n s 



H 





24 



Tests resulting in significant F- values (see Table II and text) 



Table IV, Scheffe Values for the Twelve Tests 





Test 


Hardcopy 
versus 
Pos itive 


Hardcopy 
versus 
Negati ve 


Positive 

versus 

Negative 


1 , 


Narrative (50) 


. 4590 


1.115 


. 100 


2, 


Narrative (25) 


,8190 


1. 548 


. 120 


3. 


Short Paragraph 


. 0007 


1 . 777 


1 . 830 


4, 


Figure Identification 


14. 5000* 


26. 080* 


1. 680 


5, 


Length Estimation 


7.4800* 


5. 750* 


.110 


6 , 


Symbol Translation 


9. 9000* 


13. 770* 


.310 


7, 


Graphs 


3. 0200 


12. 070* 


3. 020 


8, 


Tables 


3. 2000 


9. 080* 


3. 630 


9. 


Mechanical Drawing 


2. 1000 


1 . 840 


. 008 


10. 


Schematic s 


. 0287 


. 003 


. 002 


1 1 . 


Flow Diagrams 


.1150 


1.015 


1. 870 


12. 


Number Verification 


8.4300* 


6. 850* 


. 080 



* Significant beyond the , 10 level (4,47) 



eric: 









The results, presented as percentages in Table V, indicate that students 
in ail experimental groups were extremely accurate on all hut three 
tests (Short Paragraph, Length Estimation and Schematics), and in 
these three tests, the groups were mutually consistent. This indicates 
that the test instruments were primarily speed tests; that is, any 
answer given had a high probability of being correct. Therefore, the 
significant differences in performance indicated in Table II were due to 
differences in the number of responses attempted, or speed effects. 

This interpretation is supported by the fact that there were no real 
differences among the three groups in terms of accuracy (as defined 
above); for any of the tests. 

To test the hypothesis that students of varying intelligence are 
differentially affected by the mode of presentation, subjects were 
arbitrarily placed into the following groups based on their AFQT per- 
centile scores; Group I, 80-100; Group II, 50-79; and Group III, 

0-49. * Twelve one-way analyses of variance were computed' for each of 
these groups. The resultant F ratios, as well as the means and stan- 
dard deviations for the test exercises in each of the three AFQT groups, 
are presented in Tables VI, VII, and VIII. The analyses indicate that 
for Group I, F ratios were significant beyond the ,05 level of signi- 
ficance for Test 6, Symbol Translation, and Test 7, Graphs; and beyond 
the .01 level for Test 4, Figure Identification, 

In Group III, F ratios were found to be significant beyond the 
.05 level for Test 2, Narrative (25-minute), and Test 3, Short 

Parag aph; and beyond the ,01 level for Test 5, Length Estimation; 

* S 

- _ 

❖ AFQT scores were unavailable for four subjects, resulting in an 
overa ll sample size of 86 for this analysis. 
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Sign if i c ant b e y ond th e . 1 0 1 e ve 1 { 2 » 4 7 ) 
Significant beyond the . 05 level (3.32) 
Significant beyond the .01 level (5. 3 9) 
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Test 7, Graphs; and Test 8, Tables, There were no significant dif- 
ferences for Group II. 

Since significant differences were found in both the 80- 100 per- 
centile groups and the 0-49 percentile groups, a Scheffe test of post-hoc 
comparisons was computed for ail pairs of means in these groups. The 
results, presented in Tables IX and X, indicate that for Group III 
(0-49 AFQT percentile scores) the mean score for subjects using the 
hardcopy presentation were significantly higher than the mean scores 
for subjects using either the positive- image or the negative - image 
fiche presentations for Test 3, Short Paragraph; Test 5, Length 
Estimation; Test 7, Graphs; and Test 8, Tables, The hardcopy group 
performed significantly better than the negative- image group only, on 
the 25-minute narrative exercise. 

For Group I (80- 100 AFQT percentile scores) the hardcopy 
mean was significantly higher than both the positive and negative 
microfiche means for Test 4, Figure Identification, and significantly 
higher than the negative- image means for Test 6, Symbol Translation; 
Test 7, Graphs; and Test 11, Flow Diagrams, All of the differences 
reported above were significant beyond the , 01 level. Again, none of 
the differences between means for positive versus negative- image 
presentations were significant for any of the AFQT groups examined. 



Table IX. Scheffe Values for the Twelve Tests 
(80- 100 AFQT Scores) 



Hardcopy Hardcopy Positive 

versus versus versus 





Test 


Positive 


Negati ve 


Negative 


1 . 


Narrative (50) 


. 6974 


.5138 


.0213 


2. 


Narrative (25) 


. 6490 


1 . 7392 


. 2457 


3, 


Short Paragraph 


. 4108 


. 0002 


. 4428 


4 . 


Figure Identification 


6. 6700* 


1 5. 5770* 


1 . 6944 


5 . 


Length Estimation 


2. 4750 


1 . 7297 


.0138 


6. 


Symbol Translation 


3. 3000 


8. 5259* 


1 . 0982 


7 . 


Graphs 


1 . 5000 


7. 2421* 


2. 2048 


8. 


Tables 


. 0963 


3. 7293 


2. 5826 


9. 


Mechanical Drawing 


. 4485 


. 1699 


, 8310 


10. 


Schematic s 


. 0321 


. 0040 


. 0157 


11. 


Flow Diagrams 


1 , 6144 


5. 7800* 


1 . 2417 


12, 


Number Verification 


1.2356 


. 6742 


. 1 i 4 5 



* Significant beyond the . 10 level (4. 941 
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Table X. Scheffe Values for the Twelve Tests 
(0-49 AFQT Scores) 





Test 


Hardcopy 
v e r s u s 
Positive 


Hardcopy 

versus 

Negative 


Positive 

versus 

Negative 


1 . 


Narrative (50) 


4. 4500 


2. 3800 


. 8308 


2. 


Narrative (25) 


4. 5800 


6. 0500* 


. 0643 


3. 


Short Paragraph 


7. 6100* 


6.0200* 


. 0651 


4. 


Figure Identification 


1 . 4240 


4. 2220 


. 1372 


5. 


Length Estimation 


1 1. 8300* 


14. 9700* 


. 2228 


6. 


Symbol Translation 


4,4950 


2. 4290 


. 8302 


7. 


Graphs 


15. 0300* 


17. 4400* 


. 44 96 


8. 


' Tables 


5. 6378* 


13. 6450* 


1945 


9. 


Mechanical Drawing 


.0167 


. 1021 


.0127 


10. 


Schematic s 


. 1381 


2. 4700 


.6622 


11. 


Flow Diagrams 


3762 


.0219 


. 5083 


12. 


Number Verification 


2.4135 


2. 8138 


. 0708 



* Significant beyond the . 10 level (5.40) 



IV. DISCUSSION AND CONCLUSIONS 



While this study was conceived as a replication of the Baldwin 
and Bailey investigation, it was executed in a manner consistent with 
achievement of the goats of the larger program: Development of Micro- 

form Materials for Use in Technical Training. Before presenting a 
discussion of the study results in the context of the larger program, 
the replication aspects will be developed. 

R epUcation 

Baldwin and Bailey's work was an attempt to develop psycho- 
metric instruments of known reliability and content validity for measur- 
ing an individual's ability to process each of several types of 
information through the visual modality. These instruments were then 
used to determine the influence of each of three presentation modes on 
the individual's information processing ability. 

Their development of the test instruments was only partially 
successful in terms of the original design. Three test instruments, 
evaluating the subjects' ability to read continuous prose, were validated 
by factor analysis. These instruments required 100 minutes of the 
total 162 minutes allocated for all tests. The remaining nine instru- 
ments, taken in groups of three, were designed to measure either 
comparative visual judgment or perceptual speed. These instruments 
were not validated under the Baldwin and Bailey a priori groupings. 
However, taken as a single group of nine, these instruments did have 

1 f 

significant factor loadings for either comparative visual judgment or 
perceptual speed, The content and validity of these two groupings is 

Y? \ 

very important in understanding the' replication achieved in the present 
study. 34 
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Baldwin and Bailey found no significant difference in perfor 

USing ' hl ' '“ rr * ,iv « »•««»« any of the presentation 

modea (Hardcopy, Po.itive-fiche, Negativo-fiche): This result was 

t-nfunud by the present study in terms or the overall experimental 
results. They found no significant difference in performance across al 
instruments for the positive versus the negative fiche presentation: 

This result was also confirmed. They did. however, find significant di 
ferences between fiche and hardcopy performance for three of the nine 
instruments in the non- narrative grouping, all requiring precise visual 
discrimination. This result was confirmed, but three additional instru- 
ments also Showed significant performance differences between the 
hardcopy and one or both of the fiche presentation*. 

In genera, then, the Baldwin and Bailey results were replicated, 
rhetr main results could be extended to a different environment, a 
different and to different equipment. However, the discovery of 

the addit ionai instruments showing significant differences in perf„r_ 

mance between hardcopy and the film presentations in the present 
study requires elaboration. 

Three general observations must be made in order to provide 
proper context. (1) The tost instruments legisiate performance dif- 
ferences primarily in terms of speed.* Where accuracy does enter 

the performance comparisons, it (accuracy) is independent of the 

presentation mode and iq r i,, ar .|,, j , 

nd S Lltarl y dependent on content of the test 

instrument (see Table V.) (2) While statistically significant dif- 

ferences in performance were found for several of the test instruments, 
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* Baldwin and Ba'Uv also r,. n nri f i, • , 

-> dii o report this observation. 
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there is clearly no fundamental breakdown in comparative perfor- 
mance between fiche and hardcopy presentations. (3) The performance 
of a complex task, using a reader presentation, is not strictly equiva- 
lent to the performance of the same task using hardcopy only. In the 
test environment, the reader text presentation and the exercise 
answer sheet could not be spacially related in the same way as could 
the hardcopy text presentations and answer sheets. This split-function 
task alone causes some performance decrement with a film presentation. 
It is felt th.it tht general trend toward poorer mean scores with the 
fiche presentations reflects this decrement. (See Table VII for trend 
details.) The importance of this observation can he seen if extremes 
are cited. In the narrative (Test I), the subjects supplied approximately 
one answer each minute for 50 minutes; in Test 6, symbol translation, 
the subjects supplied app roximately 12 answers each minute for 10 min- 
utes. All the tests in the second group of nine have strong split- 
function characteristics. 



Against this background, there are two methodological dif- 
ferences in the studios that might explain the occurrence of significant 
performance differences in more of the non-narrative test exercises. 



First, in Baldwin and Bailey's study only three test sequences were 
used, with the narrative material always presented first. In the 
present study, the test exercises were presented in 15 different but 
counterbalanced sequences so that the narrative material might be found 
at the beginning, middle, or end of a sequence. Second, the Baldwin 
and Bailey study apparently tested in a sequence of presentation modes; 
in the present study, all modes were test concurrently. It iy felt that 
these procedural differences alone are sufficient to explain why three 



more of the exercises resulted in significant performance differences 

f* F 
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to hypothesize that this "added 



It is plausible however, 
sensitivity" was due in part to differences in the distribution of AFQT 
scores in the populations sampled. An analysis (discussed below) 
indicated that different intelligence groups vary in their response to 
the method used to present technical training material. Therefore, 
alterations in the composition of populations with regard to intelligence 
groupings will affect the overall sensitivity of the test. For example, 
the results of the present study indicate that while subjects in the 
middle intelligence range are insensitive to differences in the mode of 
presentation, significant differences favoring hardcopy occurred in the 
higher intelligence group on the same three exercises which resulted 
in significant differences in the Baldwin and Bailey work, The inclusion 
of lower intelligence subjects as 20% of the population in the present 
study resulted in significant differences on three additional test 
exercises. It is hypothesized, therefore, that the distribution of 
AFQT scores in the population used in the Baldwin and Bailey study 
was skewed to omit a certain number of subjects in the 0-49 range, 
thus decreasing the sensitivity of their testing as compared to the 
present study. 

In order to complete the comparative aspects of the two studies, * 
it should be pointed out that the mean scores for the narrative and 
short paragraph exercises in the present study were substantially 
higher than those reported in the original study for the same tasks. 
These discrepancies are possibly due to differences in the testing 
procedure or environmental situation, and also might reflect differences 
in the composition of the sample groups. Information concerning such 
discrepancies, however, is insufficient to make further comment. 
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Appendix D presents a table of means and standard deviations 



for the twelve tests obtained by Baldwin and Bailey. Thesv may be 
compared with Table III. 

Microform Materials for Technical Training 

The results of the study have d ! rect implication for the develop- 
ment of microform materials to be used in training. The analysis 
dealing with the question of whether the mode of presentation differen- 
tially affects various intelligence groups, is particularly useful. For 
example, all of the significant differences found between student per- 
formance using the hardcopy presented ion and student performance 
using a microfiche presentation occurred in the higher and lower 
intelligence groups. No significant differences were found on any of 
the test exercises between hardcopy and microfiche for the inter- 
mediate intelligence group (50-79 percentile) . The lower intelligence 
group (0-49 percentile) was affected most strongly by the mode of 
presentation. Hardcopy subjects in this group performed* significantly 
better than subjects in either the positive or negative microfiche 
groups on four of the twelve test exercises (Short Paragraph Narrative, 
Length Estimation, Tables, and Graphs) and significantly better than 
the negative microfiche group on the 2 5- minute narrative exercise. 

This was the only analysis which led to significant differences on any 
of the narrative materials. These differences suggest a possible 
limitation for training applications for students in lower intelligence 
groups using microfiche equipment. Further research, using a larger 
sample of subjects in each intelligence classification would be neces- 
sary to identify these limitations more adequately. 

The performance of the higher intelligence group (80-100 per- 
centile) also was affected by the mode of presentation, but less 
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dramatically. In this group, performance on the hardcopy presentation 
was significantly better than performance on either the positive or 
negative- image microfiche presentations on the Figure Identification 
exercise and better than the negative- image group only on the Symbol 
Translation, Graphs, and Flow Diagrams exercises These exercises 
are very much dependent on the recognition of individual type char- 
acters, or precise visual discrimination. 

While the recognition of this performance- intelligence link 
is important, one very positive result was the discovery that the 
intermediate intelligence group {50-79 percentile) could both 
read and perform tasks requiring visual judgement and perceptual 
speed without significant performance decrement utilizing the reader 




The post-hoc analysis which operationally defined performance 
indicated that the test instruments could be characterized as primarily 
speed tests. That is, the significant differences encountered in the 
analyses of variance and the Scheffe tests reflect primarily the effects 
of the reader presentation on the speed at which the students worked. 
This result indicates that accuracy can be maintained using microforms 
and does not, in itself, preclude their use in Air Force technical train- 
ing programs. It simply means that where appropriate, more time 
should be allowed for the completion of split-function tasks. Further 
research should be conducted, however, which is designed specifically 
to reflect machine effects on speed and accuracy as separate factors. 

Finally, comment is appropriate relative to the question of 
image polarity. The use of the Scheffe test in the present study allowed 
the comparison of all pairs of means in the analysis since it has no 
requirement that the post-hoc comparisons be independent. As in the 



previous study, no significant performance differences were found 
between the positive- image and the negative- image fiche presentations 
on any of the twelve test exercises. However, a comparison of the 
hardcopy means with each of the microform means indicated that on 
two of the test exercises (tables and graphs), the means for the hard- 
copy group were significantly higher than the means for the negative- 
image group but not significantly different from the means of the 
positive-image group. This finding documents a general tendency over 
all test instruments for the negative- image group to be less effective 
in the performance of the tasks than the positive- image group. 

Since the factor analysis conducted by Baldwin and Bailey indi- 
cated that nine of the twelve test exercises had high loadings on the 
comparative visual judgement and perceptual speed factors, the above 
results also comment on the question of visibility versus readability 
discussed earlier. Given the split-function complexity added to the 
tasks by using ajj_y reader presentation, the above results appear to 
indicate that positive -image microforms are better able to meet the 
visibilit' (individual character recognition) requirements than are 
negative -image microforms. This type of interpretation is supported 
by the performance of the higher intelligence group (80-100 percentile) 
which had particular difficulty with the negative -image presentation 
(see Tables VI and IX). However, the positive -image presentation 
resulted in the poorest performance by subjects in the lower intel- 
ligence group (0-49 percentile). This ambiguity is perhaps partially 
explained by differential effects of the negative -image as a novel 
approach among various intelligence groups or by differences in 
previous expedience. Further research should be conducted to clarify 
the issue of image polarity by examining the role of image degradations 
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f-'t* visibility differences) directly as they affect student performance 
u ,er various presentation modes. By testing with successively poorer 
visibility , the interaction between image degradation and image polarity 
could be documented. 
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APPENDIX A 



TEST INSTRUCTIONS AND SAMPLE ITEMS 



The following pages consist of reading matter which you 
will be asked to read for both speed and accuracy. On each page 
three words have been eliminated and replaced by ’’Tanks, Your 
task will be to read the material and supply the missing words. 

Read the following example and identify the missing word. 

Survivors must know how to exploit to their advantage 
the meat of game and fish, how to prepare plant food for 
eating and above all how to ace or plish this with the least 
effort and physical exertion. Many men have died from 
starvation because they have failed to take full advantage 
of a game carcass or the plant 1 available. 

In the practice example the word "food” was eliminated. 
You would therefore write "food" on the separate answer sheet in 
the space corresponding to the number of the blank. 

When you are told to begin, turn the page immediately and 
begin to work. You will be allowed 50 minutes for this exercise. 

You are not expected to complete the test. Do not spend too much 

time on any one word, but do not hurry. Attempt to read at a steady 
pace , 



No words are eliminated on the first page to allow you to 
familiarize yourself with the material. Beginning on page two, record 
on the separate answer sheet the missing word corresponding to the 
number in the blank. Please do not mark on this test booklet, 

A * - 

TESTS 1 AND .2.,.,. NARRATIVE 



The following exercises consist of short paragraphs in which 
one word has been changed. Your task will be to read the paragraphs 
and identify the word which is not consistent with the meaning of the 
paragraph. Read the following practice example and identify the 
inappropriate word. 

Survivors must know how to exploit to their advantage the 
meat of game and fish, how to prepare plant food for eating and 
above all how to accomplish this with the least effort and physical 
exertion. Many men have died from drowning because they failed 
to take full advantage of a game carcass or the plant food available. 

In the practice example the word "drowning" does not agree with 
the context of the rest of the paragraph You would therefore write the 

word "drowning" on the separate answer sheet to indicate the incorrect 
word. 



Now read the following additional practice examples. This time 
write the incorrect word on the separate answer sheet. 



1, The sea of the Arctic Basin and the shores adjoining it 
have few fish or shellfish useful for survival purposes. The 
inland lakes and rivers of the surrounding coastal tundra, 
however, generally have plenty of animals which are easy to 
catch during the warmer season. 

*“ ^ mussels are the only available food, select only those 

in deep inlets far from the coast. Remove the dark intestinal 
gland after eating. 



TEST 



NARRATIVE 



SHORT PARAGRAPH 



This is a test of your ability to match a given object. At the left of 
each row is an object. To the right are five test objects, one of which 
matches the object at the left. Look at the example below: 



1 . 






8. C. 0. E, 



The third test object (C) is the correct response, because it is the 
same as the object at the left. 

Now practice on the problems below. Circle the letter on the separate 
answer sheet for the object that matches the one at the left. Make no marks 
on the test booklet. 



2 . 





4 , 




5 . 




9 

A, B. C, D. E. 

□ I^ZIBA 




A. B. C. D. E. 



The correct responses for the practice exercises above should be: 

2 = B; 3 = E; 4 = D; and 5 = b. 



When you are told to begin, turn the page and immediately begin to 
work. You will have _____ minutes for each of the two exercises for this part. 
Work as quickly as you can without sacrificing accuracy. Each exercise has 
two pages. If you finish Exercise 1, STOP, Please do not go to Exercise 2 
until you are asked to do so, . ^ 



TEST 4, FIGURE IDENTIFICATION 

* 
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In this test you are to examine three lines or roads that connect pairs 
o£ points (•) and select the line that is the shortest . The top or high road 
is A; the middle road is B; and the bottom or low road is C, Look at the 
two sample problems below. On the separate answer sheet mark the 
shortest road by circling the correct letter under each problem. Make 
no marks on the test booklet. 




ABC 



n. 




In the examples above, A is the answer to problem I; and B is the 
answer to problem II, 

When you are told to begin, turn the page and immediately begin to 

work. You will hv<‘ rrdnutes for each of ♦ he two exercises for this part. 

Work as quickly as you can without sacrificing accuracy. Each exercise has 
onts page. If you finish Exercise 1, STOP, Please do not go to Exercise 2 
until you are asked to do so, 

TEST 5, LENGTH ESTIMATION 





•* 



4 
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This is a test of your ability to translate symbols into alphabetic 
characters. Following is a partial list of typewriter characters (symbols) 
that correspond to letters of the alphabet. 



SYMBOL 

] 

t 

@ 

! 

$ 



LETTER 

A 

B 

C 

D 

E 



SYMBOL 

% 

t 

& 



LETTE R 

F 

G 

H 

I 

j 



In this exercise you will be required to write in the blanks the alpha- 
betic character that corresponds to the given symbol. The answer will 
consist of jumbled letters rather than actual words. Refer to the above list 
of characters and complete the following practice examples. Record your 
answers on the separate answer sheet. Make no marks on the test booklet, 

1 . @ & * ) % ..... ..... ..... 

2 . ! ] $ + 

3, [ % @ — 



The correct responses for the examples above are- 1 = CHUR; 

2 = DAEG; and 3 = BFCI. 

Wh en you are told to begin, turn the page and immediately begin to 

work. There is only one page to this part. You will have minutes to 

complete the exercise. Work as quickly as you can without sacrificing 
accuracy. If you finish the exercise, STOP, 



TEST 6, SYMBOL TRANSLATION 
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This is a test of your speed and accuracy in reading a graph., The graph 
illustrated below contains four curves — A, B, C, and D. These curves plot 
the relationship of temperature to time under certain experimental conditions. 
Minutes are marked on the lower (horizontal) edge of the graph and temper- 
atures are shown at the left (vertical) edge. Study the example below. 




NUMBER OF MINUTES 

In this exercise, the minutes will be given. You are to find the temper- 
ature, corresponding to the given number of minutes, for each of the four 
curves, , 

Procedure ; Locate the desired number of minutes on the horizontal 
scale. Follow the vertical line up from that point to where it rosses Curve 
A, Then read the temperature from the scale at the left. Repeat the pro- 
cedure for each of the other three curves. Round your answer off to the 
nearest whole number. Now, complete the following practice exercises. 
Record your answers on the separate answer sheet. 

Minutes Curve A Curve B Curve C Curve D 

1. 18 __ 

2, 7 ___ 

The correct responses for the exercises above are: 1. " 10, 5, 16, 10; 
and, 2, = 5, 10, 13, 17, 

When you are told to begin, turn the page and immediately begin to 

work. There is only one page to this part. You will have minutes to 

complete the exercise. Work as quickly as you can without sacrificing 
accuracy. If you finish the exercise, STOP, 




EST- 






f 

GRAPHS 



In uhis test you will be required to locate and record values found on a 
table. The table below indicates drill sizes and their corresponding decimal 
equivalents. Note that the drill sizes may be represented as letters, numbers 
or fractions. 



SIZE 


DECIMAL 

EQUIVALENT 


1/2 


0,500 


Y 


0,404 


X 


0.397 


25/64 


0.3906 


2 


0.221 


130 


0.185 



You w i " be required to furnish the decimal equivalent, for each of the 
drill sizes indicated. Your responses will be recorded on the separate 
answer sheet. Refer to the above table and complete the following examples. 



1. 25/64 _ 

2 , 2 — 

3. Y — 



In the examples above the correct responses are; 1, = G, 3906; 2, = 

0, 221; and, 3. = 0.404, 

When you are told to begin, turn the page and immediately begin to 

work. There is only one page to this part. You will have minutes to 

complete the exercise. Work as quickly as you can without sacrificing 
accuracy. If you finish the exercise, STOP. 



TEST 8, TABLES 
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In this test you will be required to locate lines and surfaces on three 
separate views of a drawing which correspond to lines and surfaces on a 
pictorial view of the same object. In Figure 1, below you will observe a 
three dimensional view (pictorial) of a box. The box is hinged on three sides 
so that it may be spread flat. Figure 2. is a drawing of the same box with 
the top raised and the side swung around to the front. 




FIG, 2 



The drawings which follow will utilize this same format. You will 
see a pictorial view of an object. Then, the object will be shown as it 
would appear if it were hinged and spread flat on the page. Are there any 
questions related to the first example? 

The next drawing is like the one shown above except that a part cf the 
solid block is cut away. The same object is drawn in three views except 
that the n hinges n are omitted and the views are separated slightly to make 
it easier to visualize. Study the example on the following page to make sure 
the views are clearly understood. Do not, at this point, be concerned about 
the numbers and letters on the various views, 

TEST 9, MECHANICAL DRAWING 

so 
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This is a test in which you are to choose a correct path from among 
several choices. In the picture below is a box with dots marked S and F. 
S is the starting point and F is the finish. You are to follow the line from 
S, through the circle at the top of the picture and back to F, 




In the problems in this test there will be five such boxes. Only one 
box will have a line from the S, through the circle, and back to the F in the 
same box. Dots on the lines show the only places where connections can 
be made between lines. If lines meet or cross where there is no dots, there 
is no connection between the lines. Now attempt the following example by 
identifying the box which has the line through the circle. Make no marks on 
the test booklet or answer sheet. 




The first box is the one which has the line from S, through the circle, 
and back to F, The space lettered A would therefore have been circled on 
the answer sheet. 

Each diagram in the test has only one box which has a line through 
the circle and back to the F, Some lines are wrong because they lead to 
a dead end. Some lines are wrong because they come back to the box with- 
out going through the circle. Some lines are wrong because they lead to 
other boxes that do not have lines going through the circle. 



TEST 10, "SCHEMATICS 

• ■ 

* 4.';. ** 

51 



42 



This is a test to find the shortest route between two places as quickly 
as possible. The drawing below is a map of a city. The dark lines are 
stre 3ts , The circles are road-blocks, and you cannot pass at the places 
where there are circles. The numbered squares are buildings. You are to 
find the shortest route between two lettered points. The number on the build- 
ing passed is your answer. 

Ru les : 1, The shortest route will always pass along the side of one and 

only one of the numbered buildings, 

2, A building is not considered as having been passed if a route 
passes only a corner and not a side, 

3, The same numbered building may be used on more than one route. 

Look at the sample map below. Practice by finding the shortest route 
between the various points listed at the right of the map. Your answer is to 
be recorded on the separate answer sheet. The first problem has been marked 
correctly. 




The shortest 
route from i 

1. A to Z 

2. 1 to a 

3 . P to J 

4. V to K 

5. 0 to F 

6. G to M 

7. D to Q 

8. F to T 



Passes 
building : 




The answers to the other practice problems are as follows: 2 passes 5; 
3 passes 3; 4 passes 2* 5 passes 4* 6 passes 4; 7 passes 6; and 8 passes 5, 



TEST 11, 



FLOW DIAGRAMS 



This is a test to find out how quickly you can compare two numbers and 
decide whether or not they are the same-. If the numbers are the same, go 
on to the next pair, making no mark on the answer sheet. If the numbers are 
not the same, circle the number on the separate answer sheet corresponding 
to the number at the left of the incorrect pair. Now, complete the following 
practice examples. Make no marks on the test booklet. 



1 . 


659 — 


659 


11, 


7343801 


7 ”3801 


2. 


73845 — 


73855 


12. 


18824 


18824 


3. 


1624 — 


1624 


13. 


705216831 


795216831 


4. 


438 — 


436 


14. 


971 


-971 


B. 


4821456 — - 


4821459 


IS, 


446014721 


446014721 


6. 


658331 


656331 


16. 


5173869 


6172869 


7. 


11653— 


11652 


17. 


643001717 


6430017 


8, 


617439428 


617439428 


18. 


518198405 


618168045 


&, 


1860439 


1860439 


19. 


55179 


66097 


10. 


90776105 


90716105 


20. 


63216067 


63216057 



The incorrect pairs in the practice examples are as follows: 2, 4, 5, 

6, 7, 10, 13, 16, 17, 18, 19, and 20, These numbers should have been 
circled on the answer sheet. 

When you are told to begin, turn the page and immediately begin to 

work. You will have minutes for each of the two exercises for this part. 

Work as quickly as you can without sacrificing accuracy. Each exercise 
has one page. If you finish Exercise 1, STOP, Please do not go to Exercise 
2 until you are asked to do so. 
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APPENDIX C 
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COMPUTING THE SCHEFFE METHOD 
OF POST -HOC COMPARISONS 

The following method of making selected a posteriori and com- 
plete sets of comparisons among experimental group means was devol 
oped by Scheffe (5), A simple means of applying this method is 
suggested by Furguson (4) according to the following procedure. 

Step 1 . Calculate F ratios using the following formula: 

2 = (X, - Xz ) 2 a ill ~ Xil 2 

Sw 2 /nj + Sw 2 /n 2 SwNnj + n 2 ) /njn 2 

where Sw 2 equals the within -group variance, and n equals the sample 
size. 

S tep 2. Consult a table of F and obtain the value of F required 
for significance at the desired level for df, = k-1 and df 2 = N-k. 

Step 3 . Calculate a quantity F', which is k-1 times the F 
required for significance at the desired level; that is, F 1 = (k-l)F, 
Step 4 . Compare the values F and F ! . For any diflerence to 
be significant at the desired level, F must be greater than or equal to 

F', 
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Appendix D, Test Means and Standard Deviations in the 
Baldwin and Bailey Study 



ERIC 



Test No, 



Offset Copy 

N=4B 

X 8, D 



Positive 

N=43 

X s'd. 



Negative 

N=45 

T 



* Tests in which mean scores were substantially lower in the Baldwin and 
Bailey study than in the present study (see Table III). 
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